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Abstract 

In this report, we present a formal approach that addresses the problem of 
emergence of phase transitions in stochastic and attractive nonlinear threshold 
Boolean automata networks. Nonlinear networks considered are informally de- 
fined on the basis of classical stochastic threshold Boolean automata networks 
in which specific interaction potentials of neighbourhood coalition are taken 
into account. More precisely, specific nonlinear terms compose local transition 
functions that define locally the dynamics of such networks. Basing our study 
on nonlinear networks, we exhibit new results, from which we derive conditions 
of phase transitions. 

1 Introduction 

The model of deterministic Threshold Boolean automata networks (called TBANs 
for short in the sequel) has been developped in the 1940's by McCulloch and Pitts 
in [MP43] as a way to represent logically the interactions between neurons over time. 
In parallel |0ns44| has been addressed the problem of existence of phase transition 
in the two-dimensional Ising model of ferromagnetism |Isi25] . Taking into account 
that the classical Ising model can be generalised in the Boolean framework by the 
Boltzmann machine [AHS85J, that is a stochastic variation around deterministic 
TBANs, we propose in this report a partial solution of the problem of emergence of 
phase transitions in this context, as it has been performed in the case of the classical 
Ising model by Dobrushin and Ruelle in }Dob68cl IRue69| . More precisely, we present 
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a generalisation to nonlinear TBANs of theoretical results of phase transitions due 
to the influence of fixed boundary conditions already obtained in the framework of 
linear TBANs |D JS081 IDS08] . 

After a presentation of important definitions for the study in Section [21 new 
theoretical results of phase transitions are given. 

2 Model definitions 

Although this work focuses on nonlinear TBANs whose architecture is partially 
defined in a part of the lattice on Z 2 , let us present TBANs from the general point 
of view. Let N be such an arbitrary network. N is composed by n nodes interacting 
over time through a labelled digraph G = (V, A), where V is the set of nodes, 
elements of Z 2 , whose states are valued in {0, 1} (0 when the node is inactive and 
1 when it is active) and A C V x V is the set of arcs linking elements with each 
others. A TBAN is characterised by: 

• an interaction matrix W of order n: it defines the structure of N and each 
coefficient Wij € M is the label of arc (j, i) of A and gives the interaction 
weight node j has on node %. If Wij is null, then (j, i) £ A, else node j is said 
to be a neighbour of node % and we note j EA/j. In this case, node j is called 
an inducer /activator (resp. repressor /inhibitor) of node i if Wij > (resp. 



• a threshold vector of dimension n: each element is called the activation 
threshold of node i. 

• n local transition functions which define the local evolution of each of the nodes 
in the TBANs. The general concept of the local evolution of a node i, namely 
the calculation of its state at time t + 1 being given N and the state of any 
node k € V at time t, is the following: if the potential of i at time t, i.e., the 
sum of the interaction weights received from its active neighbours, is greater 
than (resp. not greater than) its activation threshold then its state at time 
t + 1 equals 1 (resp. 0). Thus, if we denote by Xi(t) the state of node i at time 
t, the local transitions functions are: 



where H represents the Heaviside (or sign-step) function and is such that 



Wij < 0); 




(1) 
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An application x : V — > {0, 1} is called a configuration of N. In other words, the 
vector x(t) = (xj(i))j g y G {0, l} n is the configuration of iV at time i. 

In the sequel, in order to highlight the emergence of phase transitions from the 
dynamical behaviour of TBANs, we will give a particular attention to the notion 
of boundary conditions. We will explain this later. Nevertheless, since we focus 
on TBANs on Z 2 , let us present general definitions of the notions of center and 
boundary of a graph G = (V, A) that we will be able to adapt in the context of 
two-dimensional lattices. Basic notions of graph theory are considered to be known 
(c/. |Har69j ). 

Definition 1. Let G = (V,A) an arbitrary digraph. The boundary of G is the set 

of its sources. 

Let u and v be two distinct vertices of a digraph G = (V, A). The distance d(u, v) 
is the length of the shortest path linking u to v. If there is no path from u to v , 
d(u, v) is defined as equal to +oo. 

Definition 2. Let G = (V, A) an arbitrary digraph. The eccentricity e(u) of a non 
isolated vertex u £F is the maximal distance less than +oo from u and every other 
vertex of G, such that e(u) = Max ve g\ u (d(u,v) < +oo). 

Definition 3. Let G = (V, A) an arbitrary digraph. The centre of G is the set of 

its vertices of minimal eccentricity. 

In this report, we differentiate the notions of neighbourhood and strict neighbour- 
hood of nonlinear two-dimentional TBANs according to the following definitions. 

Definition 4. Let N be a two-dimensional TBAN on Z 2 . The neighbourhood Mi 
of node i is the set composed of nearest-neighbours nodes (i.e., nodes at distance 1 
to i) of i and i itself. 

Definition 5. Let N be a two-dimensional TBAN on Z 2 . The strict neighbourhood 
Aj of node i is such that Aj = Mi \ {i}. 

Let us now define the properties of isotropy and translation invariance of the 
two-dimensional TBANs considered. 

Definition 6. Let N be a two-dimensional TBAN onl? . N is isotropic if and only 
*f: 

Vi G N, Vj,j' G Mi, Wij = Wij>. 

Definition 7. Let N be a two-dimensional TBAN onH? . N is translation invariant 
if and only if, given ji, • • • , Jfc G Mi, it holds that: 

Vi, il G N, 3s G Z d , il = % + s, W G {1, . . . , k}, j[ = jz + s : Wij i = w v y . 
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Figure 1: An arbitrary TBAN N on Z 2 whose nodes are in white and light grey (in 
the case of central nodes) and boundary d ex tN is the set of nodes coloured in dark 
grey. 

As a consequence, TBANs considered in this study are symmetric, i.e., they are 
such that Vi, Vj € Afi,Wij = Wjj. According to these properties of isotropy and 
translation invariance, it is easy to see that Definition [3] can be applied directly 
to nonlinear TBANs on Z 2 . Conversely, the set of boundary obtained from the 
application of Definition [1] in this networks is the emptyset. Hence, boundary need 
to be built. The building process chosen consists in adding structurally specific 
nodes [Mar94j. This leads to the following definitions, considering an arbitrary 
TBANs N whose underlying digraph G = (V, A) is such that V C Z 2 and that 
V c = Z 2 \ V is the set of vertices of N c , said to be the complement of ./V in Z 2 . 

Definition 8. The external boundary (called boundary for short), denoted by 
dextN, is the set of nodes of N c at distance 1 (in terms of distance in 1?) to at 
least one node of N such that: 

d cxt N = {i £ N c \ 3j £ N : i G Mj,j £ Mi}- 

An illustration of centre and boundary of a TBAN on Z 2 is given in Figure [TJ 

TBANs in the sequel are attractive, i.e., they are such that Wn < and Vj € 
Ai,j ^ i,Wij > 0. Note also that activation thresholds are all fixed to and that 
auto-interaction potentials are always taken into account. Thus, the itfj^'s play the 
role of activation thresholds. Furthermore, as said in the introduction, nonlinearity 
is added in the model of TBANs considering that interaction potentials that act on 
a node i at time t are not only reduced to the combination of the auto-interaction 
potential and the nearest-neighbours potential Y^jeAi W i>3 ' x j(t)- Indeed, we 
consider also coalition potentials. For instance, given a node i of a TBAN N at 
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time t whose state is not known, if we consider that the evolution of node i takes 
into account coalition of neighbours couples, the interaction potential of node i 

equals ■uv + SjgA l w i,j ' x j (*) + S j,ieNi w i,{j/) ' x j W ' x t{t)i where w it ^ defines the 
interaction weight that the couple of active nodes j and £ has on i. Remark that 
the Wi/s correspond to thresholds (considering them separately) and that the i's 
play the role of elements of coalitions (considering them as parts of couples, triples, 
quadruples and quintuples in the sequel) 

Let T € M + be the temperature parameter. We give the following notations of 
interaction potentials for every node i of an arbitrary TBAN N to ease the reading: 

• ^0,i = called singleton potential, a function of the auto-interaction weight 
of an arbitrary node i (always taken into account); 

• u i,i,j = where j € Aj, couple potential, a function of interaction weights 
received by node i from its strict nearest neighbours; 

• U2 : i u t g\ = "'y'^ , where j,£ G Mi ; j 7^ £, called triple potential, a function of 
interaction weights received by node i from couples of its active neighbours; 

• u 3,i,(j,e,m) = W ''^' m> , where j,£,m £ Mi ; j / f / m, called quadruple 
potential, a function of interaction weights received by node i from triples of 
its active neighbours; 

• u 4,i,(j,e,m,p) = W '' <J y m ' p) , where j,£,m,p € Mi ; j 7^ £ 7^ m 7^ p, called 
quintuple potential, a function of interaction weights received by node i from 
quadruples of its active neighbours. 

Definition 9. A stochastic TBAN N of order k on 1? is a TBAN whose local 
transition function fi calculates the probability for node i to be at state 1 at time 
t+1 knowing the configuration projected on its neighbourhood Mi at time t and taking 
into account 1-uple, 2-uple, . . . , k-uple potentials, with 2 < k < 5 such that: 

W <E AT - {1, . . . , »}, P(x, (i + !)_„)- 1+e „,, +s:jeA|m , l , J , il „^, A ,, . P) 
w/iere </>f(Aj) is the nonlinear term such that: 

4>K^i) = Yl • x A l ) -xt(t) + ...+ 

U k -l,i,(j,l,m,p,q) ■ x j(t) ■ Xi(t) ■ X m (t) ■ X p {t) ■ X q {t). 
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Remark that, in the case of TBANs of order 2 (i.e. (f)f(Ai) = 0), if T tends to 
0, then the stochastic local transitions functions defined in [2] are equivalent to the 
deterministic one defined in Equation[TJ Before going further, let us insist that, from 
Definition [91 we derive that nonlinear TBANs studied in this report are stochastic 
TBANs of order at least equal to 3. 



3 Theoretical approach and phase transitions 

Let us recall that TBANs considered in the sequel are isotropic, translation 
invariant, nonlinear. Moreover, we add that they are attractive. Given a stochastic 
TBAN N, that means that Vi G N, n ,j < ; Vj G Aj, ui }i j > 0. 

3.1 Projectivity matrix 

Definition 10. A cylinder [A, B] is a configuration x such that: 

[A, B] = {x | Vi G A, Xi = 1; Vi G B, x { = 0}. 

If \x denotes the invariant measure of a stochastic TBAN N composed of n nodes, 
indexed from 1 to n, such that n tends to infinity, we have the following projectivity 
and conditional relations. Indeed, we can write projectivity equations such that: 

\JA,B c N | An 5 = 0, Vi G A, 

H([A, B]) + fj,([A \ {i}, B U {*}]) = [i([A \ {i}, B}), 

where n([A, B]) is the probability to observe the configuration [A, B\. We calso write 
conditional equations (i.e., the Bayes formulas) such that: 

ViGiV,M[{i},0])= UAB)-fi([A,B]), (3) 

A,BcN | AnB=®, AllB=N\{i} 

where $i(A,B) denotes the conditional probability that state of node i equals 1 
knowing cylinder [A, B] such that: 



f i(x i = 1 | [A,B]) = $i(A,B) 



c 



u 0,i+Ej 6 A ■ i' x 3 ( t )+ r Pi ( A i)) 



1 _i_ e u o,i+J2jeAi u ^,r x i( t )+<l , H A i) ' 



Consider L = (N U <9 ex t-^0 \ {O} such that nodes of L are ordered according 
to the lexical order of their indices. For every subset K of L of size k, we de- 
note by jx the minimal index of nodes belonging to K. Projectivity matrix M 
of order 2' L \ is defined such that (i) the 2^' — 1 first lines contain respectively 
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the coefficients of the projectivity equations for any of the 2^' — 1 different cou- 
ple and (ii) the last line contains the coefficients of the conditional equation 

M([{0},0]) = Ea.bcJV I AnB=Q,AuB=N\{0}®( A > B ) ' MIA B)) that calculates the 
global probability for the central node to be active. The system of equations ob- 
tained from the projectivity and conditional equations is: 



M ■ 



( MMD \ 

K[L\ {1},{1}]) 
\ {2}, {2}]) 

K[K,L\K}) 
»([K\{j K },(L\K)u{j K }]) 

M ([{1},L\{1}]) 

V MM) J 



K[L\{2},9\) 



\ 



»([K\{j K },L\K}) 



/*([M\{1}]) 
V M([{O},0]) 



(4) 



From this system of equations, it is easy to write: 



M 



/I 
1 
1 
1 








1 





1 








1 













1 













1 













1 






\$0 $1 $2 $3 $4 $E 






















1 





$13 $ 



14 



\ 








1 



where <J> = $(A O ,0), $i = $(A \ {1}, {1}), $2 = $(A \ {2}, {2}), . . . , * 5 = 
$(A \ {1, 2}, {1, 2}), . . . , $13 = $(A G \ {1, 3, 4}, {1, 3, 4}), . . . and $ 15 = $(0, A G ).. 

Projectivity and conditional equations are in general linearly independent. How- 
ever, under specific parametric conditions such as conditions of non uniqueness of 
the invariant measure, that is not the case. From the work of Dobrushin in [Dob68b, 
Dob68a, Dob68c, IDob69j in the framework of random fields, we derive the following 
definition. 

Definition 11. Let N be an arbitrary stochastic attractive TBAN. Let d® xt N (resp. 
dl xt N) be a boundary of N composed of nodes whose state is fixed to (resp. 1). 
The dynamical behaviour of N admits a phase transition if and only if the invariant 
measure of the Markov chain associated to N U d® xt N does not equals that of the 
Markov chain associated to N U d^N. 
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From Equations E] and Definition [TT\ we can directly write the following propo- 
sition. 

Proposition 1. Given N a stochastic attractive TBAN, the nullity of the determi- 
nant of its associated projectivity matrix M is a necessary condition for N to admit 
a phase transition in its dynamical behaviour. 

Lemma 1. [Dem81] The nullity of the determinant of a projectivity matrix is char- 
acterised by: 

DetM = 0^=> ^(-1) IA ^' -$(K,L\K) = 0. 

KcL 

Because of our hypotheses of isotropy and translation invariance, it is interesting 
to note that we can use the spatial Markovian property in order to make easier 
solving the system of projectivity equations. The spatial Markovian property implies 
that the state of the centre O of a network iV depends only on the states of its 
neighbours, which allows to reduce L to the centre O strict neighbourhood, namely 
Ao = Mo \ {O}- Then, it is simpler to build the associated projectivity matrix Mo 
of order 2 %d . 

3.2 Results 

Basing our approach on Proposition [H in this section, we prove the existence of 
parametric conditions of stochastic nonlinear TBANs that admit phase transitions. 

First, from the spatial Markovian property of TBANs and because |Aq| = 
mod 2, the right member of the equation of Lemma [1] can be written pairing the 
subsets K and Ao \ K, namely considering that: 

(_l)|AoWI . ^ Ao \ if) + (_i)l*l . $(A D \ K, K) 

= {-\)\ K \[*(K, Ao\K) + <D(A G \ K, K)]. 

By hypothesis, nonlinear term (f) {K) is symmetric and equals —2 • uo,o — 
^ieA — ^0(^-0 \ K). The symmetry property of the nonlinear term means 

that $ {K) = 4> k {k ) - <P k (Ao \ K). 

Lemma 2. Given N a nonlinear TBAN of order k and 4> (K) = —2 ■ uo,o — 
Y2jeAo rf'oi^-oXK) o, symmetric nonlinear term such that 4> (K) = 4> (Ao) — 

0q (Ao \ K), we have: 

<P (K) = <p (A )-<Po^o\K) 
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uo,o + 



+ 



0. (5) 



Proof. Let us note 4>q(Ao) — 4>q(Ao \ K) = 4> syia . Trivially, developing the left 
member of Equation [5] by definition of nonlinear terms, we can write: 



^sym > y " "-U,U / ~~ V^OV 11 ^ \ Ji ) ~ Vsym 



2 • u ,o 




-^(Ao\if) = 




jeA 




2 • ^,0 




= 0o(Ao) 








2 • uo,o 


- «i,oj 


-<$(A o ) = 




jeA 




^o.o - 


EieAo ^i-o-i 


</>o( A o) Q 



EjgAo m,o,j ^(Ao) _ n 
«o,o H 5 1 2 ~ 

which is the expected result. □ 

Lemma 3. Let N be a nonlinear TBAN of order k and <Pq(Aq) = —2 • Uo,o ~~ 
EjeA u i,o,j ^ e ^ e nonlinear term of N when every nearest neighbour of its central 
node O is active. Then: 

-o,o+ £ _^ + ^>_M =0 *(tf,Ao\J0 + *(Ao\tf,J0 = l. 

ieA 

Proo/. First, let us show that $(-fC,A \ K) + $(A \K,K) = 1. It suffices to 
multiply $(K, A \K)byl = £— — ^ , • 

e «o,o+Ejex "LOj+^oW e - 2 ""o,o-Ej 6 A «i,o, 3 -</»o( A o) 

Given 5 defined by: 

£ _ e - 2 -«o,o-EieA u i.o,j— <f>oi A o) + e -"o,o-E i6 A \K«i,o,j+</'o( ii ")- < ? ; 'o( A o) ) 

we have: 

-«o,o-E je A \x«i,o,j+</'o(^)-^o( A o) 
A \ = . 

By hypothesis, <Pq(Aq) = —2 • u 0j o ~~ J2jeA Q u i,o,j- As a consequence, we have 
e 2 ^ eA o ^o( A ) — Moreover, given that nonlinear term <$q is symmet- 
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ric: 

e -«o,o-EjeA \x ui,o,j-<f>o( A o\K) 
®(K, &o\K) ^ e -u ,o-E jeAo \K u i,o,j— <Po( A o\ K ) 

e «o,o+EjeA \if "i, j+^(AoW 
1 _)_ e u o,o+EjeA \jr u i,o,j+<^o( A o\- K ") 
= l-$(Ao\K, K). 

So, we can write: 

$(K,A \K) + <f>(A \K,K) = 1 $(A \K,K) = 1-$( J PC,A \^)- 

Expanding left and right members of the equation above leads to: 

e «o,o+E jeAo \K u i,o,j+4>o( A o\K) e «o,o+E je K »i,o,j+^W 



1 _|_ e u 0,O+E jeAo \K «l,Oj+0o( A o\^) 1 _|_ g«0,O+E je K «l,O,j+0o W ' 

which is equivalent to: 

e «0,O+E j6 A o \K «l,0,i+<^o( A \ K ) e ~ u 0,O-'EjeK u l,0,j-<t>o( K ) 

I _|_ e u 0,O + T,jeA o \K u l,0,j+<t>o( A o\ K ) I _|_ g— "0,O-Ej 6 if u i,o,j-<t>o( K ) ' 

Let us proceed to the following change of variables: let 8\ (resp. 82) be the de- 
nominator of the left member (resp. of the right member) and rj\ (resp. 772) the 
numerator of the left member (resp. of the right member) of the equation above. 
We have then: 

m _ m m ■ 8 2 _ m ■ Si 
8\ 82 81 -82 82 • 8\ 

Vi ■ = v}i ■ 8\. 



Let C, be such that: 

(• = e ^i6A \x «i,o,j— EjeK u l ,o,3+4> k o( A o\K)-4>o(K) _ 

We have: 

f = f^ m + C = m + C 
81 82 
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Thus, we can write: 
Si 5 2 

U0,O+ Yj Ul >°>3 +<t ) o( A o\K) = -U 0jO -J^«l,Oj - 4>o( K ) 
jeAo\K j&K 

<fa(K) = -2-u ,o - Yl u hO,j-J2 Ul >°>i~ ( t ) o(ko\ K )- 

And, thus, we have: 

£ = f cj> k {K) = -2 ■ u ,o ~ £ " <^(Ao \ 

5i 52 Oho 

Hence, by hypothesis: 

f = f <P k o(K) = 0* (Ao) - k o (A o \ K), 

which is the expected result. □ 

Prom Lemmas [2] and El it is easy to derive the following theorem that highlights 
an empirical sufficient condition of phase transitions in nonlinear TBANs of order k 
on Z d . 

Theorem 1. Let N be a nonlinear TBAN of order k. We have: 

cp k o(K) = <t> k (k ) - k o(Ao\K) DetM = 0, 

which means that the symmetry property of the non linear term is an empirical 
sufficient condition for detM to vanish, allowing consequently phase transitions to 
occur. 

Proof. From Lemma [1] and because of the parity of the cardinal of Aq, we can write: 



DetM = Y (-l) |AoVFr| • , L\K) = 



J- (-l)IAoWI x MK,L\K) + $(L\K,K)] = Q 



KcAo 

Then Lemma [3] leads to: 



DetM = <=^ Y (-l) |AoVK| • - = 0, 



KcAq 
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which is always true. As a result, since Lemmas [2] and [3] are based on the hypothesis 
of symmetry of the non linear term, we have from Lemma [TJ 



no, + g^^ + ^M = =► DetM = 0, 
which is the expected result. □ 
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